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BE IT KNOWN, Jeffrey M. Harrington, a citizen of tho United States and a resident of 

th e State of N e w York, invented certain n e w and useful improv e m e nts in: 



SYSTEM AND METHOD FOR SERVER-SIDE CONTROL OF A FLASH 



PRESENTATION 



of which th e following is a sp e cification 



10 



REFERENCE TO RELATED APPLICATIONS 



This application claims the benefit of U.S. Provisional Application No. 



60/269,593 entitled "SYSTEM AND METHOD FOR SERVER-SIDE CONTROL OF A 
FLASH PRESENTATION" and filed on February 15, 2001 by Jeffrey M. Harrington, which is 

1 5 incorporated herein by reference in its entirety. This application is further related to the 
following applications, which are incorporated herein by reference in their entirety: U.S. 
Patent application serial number 09/396,693 of Craig D. Ullman, Michael R. Abato, Jeffrey M. 
Harrington, and Carl R. Duda, entitled "ENHANCED VIDEO PROGRAMMING SYSTEM 
AND METHOD FOR PROVIDING A DISTRIBUTED COMMUNITY NETWORK," and 

20 filed on September 15, 1999 (hereafter, the "DCN application"); U.S. Patent application serial 
number 09/472,385 of Craig Ullman, Jack D. Hidary, and Nova T. Spivack entitled 
"ENHANCED VIDEO PROGRAMMING SYSTEM AND METHOD INCORPORATING 
AND DISPLAYING RETRIEVED INTEGRATED INTERNET INFORMATION 
SEGMENTS," and filed December 23, 1999; and U.S. provisional patent application of 

25 Michael R. Abato, entitled "A SYSTEM AND METHOD FOR PRESENTING CONTENT 
RELATED TO A TEMPORAL EVENT TO A USER VIA A VIRTUAL STAGE," and filed 
on February 15, 2001 (hereafter, the "STAGE" application"). 



device. In more particularity, the present invention relates to server-side control of a 
Flas hFLASH movie playing on a client device. In addition, the present invention relates to 
synchronizing programming with a F4as hFLASH movie playing on a client device. 



FIELD OF THE INVENTION 
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The present invention relates generally to a Ftas hFLASH movie playing on a client 
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BACKGROUND OF THE INVENTION 

Today, the capabilities of computers to provide massive amounts of educational and 
entertainment information have exploded with the Internet. The Internet has the power to 
transform society through unprecedented levels of information flow between members. 
5 Currently, on-line systems offer a variety of different services to users, including news feeds, 
electronic databases (either searchable by the user directly on the on-line system, or 
downloadable to the user's own computer), private message services, electronic newsletters, 
real time games for play by several users at the same time, and job placement services, to 
name a few. However, today, most on-line communications occur merely through text. This 

10 currently stands in great contrast to the audio/visual presentation of the alternative electronic 
medium, television. However, it is expected that as multi-media's incessant growth 
continues, audio/visual programs will proliferate and text will become less and less dominant 
in the on-line environment. Even though these programs will be introduced, the Internet will 
remain essentially user unfriendly due to its very massiveness, organization, and 

1 5 randomness. Simply stated, there is no order or direction in the Internet. Specific pieces of 
information are many times hard to find, and harder yet, is the ability to put that piece of 
information into a meaningful context. 

Television, on the other hand, has been criticized for being a passive medium— 
"chewing gum for the eyes," as Fred Allen once observed. Television has always been 

20 something you watched, not something you do. Many social critics believe that the passivity 
television depends on has seeped into our entire culture, turning a nation of citizens into a 
nation of viewers. While interactive television systems have increased the level of user 
interaction, and, thus, provided greater learning and entertainment opportunities, vast 
information resources such as databases are inaccessible from such a medium. 

25 Recent innovations in combining Internet content with television and other audio 

and/or video programming signals have been described in various patents and publications, 
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for example, United States Patent Number 5,778,181, which issued on July 7, 1998 to Jack 
D. Hidary, et aL, and also in United States Patent Number 5,774,664, which issued on June 
30, 1998 to Jack D. Hidary, et al. (hereinafter, collectively the "Hidary patents"), and also 
U.S. Patent Number 6,018,768, which issued on Jan. 25, 2000 to Craig Ulman et al. The 
5 contents of each of these patents are herein incorporated by reference in their entirety. As is 
now well known in the art, these patents describe innovative systems and processes for 
combining the user-friendly visual experience of television programming signals, and other 
time based events or signals, with information resources located on the Internet which relate 
to the programming signal (hereinafter, the "Enhanced Content"). Since segments in a 

10 programming signal are generally presented in a sequence to a client based upon a reference 
to a known event (for example, the amount of time remaining in a football game is based 
upon the kick-off, or the amount of time remaining in a recorded movie is based upon when 
the playback of the movie is started and not when it was actually filmed), such programming 
signals shall herein be regarded as applying to any signal, show, or sequence of events, 

15 whether pre-recorded or live, which are defined or based upon a temporal relationship 

(hereinafter, the "Temporal Signal"). Such Temporal Signals may include live events (for 
example, a cut-away by a television broadcaster to a then breaking news event), pre-recorded 
events, and combinations of live and pre-recorded events. 

Recently, various approaches have been implemented for providing client-side and 

20 server-side systems capable of providing Enhanced Content related to a Temporal Signal. As 
is well known in the art, such approaches generally require a client to download (commonly 
from an Internet based Web site) and then install a proprietary plug-in or software, which 
configures the client's system as a specific application. Another approach utilizes a client 
system's Web browser, and a downloaded program which configures the client system to 

25 retrieve Enhanced Content over a specific type of communications link, for a specific type of 
client device based upon the reception of a Temporal Signal and an address identifying a 
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provider of Enhanced Content related thereto. Regardless of the specific methodology, 
today's client systems commonly must download and install an application program to 
receive and present Enhanced Content program segments, which relate to a given Temporal 
Signal. 

5 Further, since the Internet has innumerable sites, which a client may or may not find 

using a search engine, producers of Temporal Signals often identify a location providing 
Enhanced Content (for example, an Internet site) by presenting a Uniform Resource 
Identifier (URI), which includes Uniform Resource Locators ("URL"), or similar address in 
the video or audio signal presenting the Temporal Signal. Once the site is identified by the 

10 client and/or the client's system, the approach then commonly requires the client system to 
register the client with the provider of the Enhanced Content. 

Following registration, the client then may actually need to select a program or 
segment for which the client desires to receive the Enhanced Content (since Enhanced 
Content for multiple programs may be accessible from a single Internet site). Once selected, 

15 the client side system then often downloads and installs a browser plug-in, Java applet, Java 
script application, Shockwave™ component, or similar program code, which configures the 
client device for connecting with a persistent socket to a server to receive the specific 
Enhanced Content. A persistent socket, for example, may be implemented via, but is not 
limited to, a TCP/IP socket, any sort of communication protocol that implements persistence, 

20 or an application layer that implements persistence. At this point, the client system is then 
ready to connect to the provider of the Enhanced Content, satisfy any pre-requisites (for 
example, providing a password, sign-on, or user profile information), and receive the 
Enhanced Content. 

As such, the approaches commonly utilized today to receive Enhanced Content 
25 generally require a client to first identify the location of a provider of Enhanced Content, 

register the client with the provider, download a program which configures the client system, 
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install the program, connect to a site providing Enhanced Content related to a specific 
Temporal Signal, and then satisfy any prerequisites prior to receiving the Enhanced Content 
(for example, providing user profile information). In short, these approaches require so much 
time and effort to configure the client side system and access the Enhanced Content that many 
clients are discouraged from utilizing such systems. 

What is needed is a means to reduce and minimize the amount of time and effort 
required by a client to receive automatically, or upon request, Enhanced Content related to a 
Temporal Signal. What is needed is a wider, richer, quicker, and more efficient system and 
process for receiving and processing audio/visual and textual database elements into an 
organized unique interactive, educational, entertainment experience. 

Macromedia fiashFLASH™ technology includes a powerful animation application, 
which may substantially replace the hypertext mark-up language ("HTML") as the application 
of choice for Web site developers. A programmer using FlashFLASH™ can create interactive 
Web sites with sophisticated animation and sound, requiring low bandwidth and small file 
sizes. The visual presentation of a Web site using HashFLASH™ is referred to as a 
F4ashFLASH™ movie. which provides a window for capturing and displaying information, 
similar to an HTML page. FlashFLASH™ movies, unlike HTML pages, stay loaded in a Web 
browser, or any device with a FlashFLA S H™ plug-in. In a most basic implementation, the 
FteshFLASH™ movie includes a series of vector graphic images that are animated by changing 
their parameters in keyframes along a timeline, conceptually similar to the way in which 
animation in a cartoon is achieved. 

For a more sophisticated site, FlashFLASH™ also includes functionality to create 

interactive movies, where the visitor to the Web site may use a keyboard or a mouse to jump to 

different parts of the movie, enter information on forms, and perform other interactive 

operations. FtashFL ASH™ movies may run from start to finish, or a viewer of the 

FteshFLASH™ movie may direct the FfeshFLASH™ movie to change state. ftashFLASH™ 

also provides for layering, which allows movies and functionality to be overlaid. For example, 

a FlashFLASH™ movie illustrating human anatomy might 
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have a first layer with graphics of a skeleton and a second layer with graphics of the muscular 
system overlaid on the graphic of the skeleton. The movie might include a third layer with 
text describing the various anatomical features. As one can imagine, layering can be used to 
enhance the functionality and visual appeal of a Web site. 
5 What is needed is a system and method for synchronizing the visual experience of TV 

with the dynamic capabilities of F4as hFLASH movies on a client device. What is further 
needed is a system and method for server-side control of aFkts hFLASH movie playing on a 
client device. 

SUMMARY OF THE INVENTION 

10 Systems consistent with the present invention provide a system and method for relating 

Temporal Signals (which appear, for example, on a television broadcast, a VHS or Beta tape, 
CD-ROM, DVD, CD, memory stick, or other medium) with a -Ras kFLASH movie on a client 
device (accessible, for example, via the Internet). Such systems do not require lengthy 
downloads, specific client devices or operating systems, specific data formats or similar 

15 constraints in order to implement the features and functions identified herein. Preferably, such 
a system is implemented on a client device capable of hosting a Web browser. As such, the 
present invention is described preferably in the context of a client device using a Web browser 
for supporting its operations. 

Further, the present invention creates a new, efficient, dynamic, diverse and powerful 

20 educational and entertainment medium. The system allows consumers to receive more 

information in a more efficient manner than either television or the Internet alone and over 
prior systems and processes utilized to present Enhanced Content related to a Temporal Signal. 
Instead of requiring client systems to execute lengthy, and sometimes problematic, downloads, 
which often require the user to perform an installation of new software on the client system 

25 prior to receiving an Enhanced Content segment, the present invention streamlines such 

processes by providing server-side control of a Flash FLASH movie playing on a client device. 
By utilizing server-side control, the present invention minimizes the amount of 
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educational setting where a student answers a question wrong, for example, the server may re- 
push material that was not understood or may even push a more detailed explanation for easier 
understanding by the student. Thus, this allows for more sophisticated user experiences 
without the necessity of performing lengthy, and sometimes problematic, downloads and 
installations of the application software. 

Another advantage of the system is that it changes the nature of advertising by making 
its application delivery more adaptable to the viewers. By keeping the complex programming 
logic on the server-side of the system, advertising can be more easily created and delivered in 
a targeted and individualized manner while allowing the client side content delivery to be 
instantly available. Branching logics and interactive sales presentations can be delivered 
without lengthy downloads. Since additional information can be now given to consumers 
automatically and without large downloads, advertising can now be more interactive, 
responsive, and substantive. Such real-time responsiveness allows customers to make more 
informed choices and spontaneous choices. Now, the act of purchasing a product seen on 
television can be streamlined— the consumer can be given the choice of buying the product 
instantly using the two-way capabilities of the system. For example, the processes of the 
present invention enable an Enhanced Content provider to push a command to the 
Flash FLASH movie playing on the client device, and the command can seamlessly display a 
button for purchasing the product at a newly displayed price. The button includes the 
functionality necessary to purchase the product from a remote location. 

In addition, users can take advantage of the two-way capabilities of the Internet to 
respond to polls, to send e-mail, or to link to additional sites. For example, a viewer watching 
a television financial news program, through the system of the present invention, can receive a 
real-time data feed that will be displayed, perhaps as a layer on the Flas hFLASH movie. 

The present invention includes a method for synchronizing programming with a 
Flas hFLASH movie on a client device, which includes receiving programming on the client 
device. The 
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programming contains a Uniform Resource Indicator ("URI"), such as a Uniform Resource 
Locator ("URL"), functional push, an object push, and a software enhancement push (i.e., the 
software on the client side can be dynamically enhanced without user intervention). The 
programming may be video programming, audio programming, or other Temporal Signals, as 
defined herein. According to one aspect of the present invention, the URI specifies a location 
from where a Flash FLASH movie can be obtained, wherein the FiashFLASH movie relates to 
the content of the programming. The Flash FLASH movie is then retrieved from the location 
and loaded on the client device. 

In one aspect of the present invention, the client device includes a Flas hFLASH player, 
a Web browser having Flash FLASH movie playing capabilities, such as a Flash FLASH plug- 
in, or another application having Flas hFLASH movie playing capabilities, such as an e-mail 
client. A connection is established between the client device and a server, such as a Web 
server, a DCN server, or a database server. To facilitate the connection, the client device 
preferably includes a receiver software layer, such as an ActiveX control, and a bridge layer, 
preferably running in a browser window with scripting capabilities such as JavaScript or 
VBScript. The receiver software layer, for example, may be located within a frame containing 
an active component capable of establishing a persistent socket or may utilize Ftas hFLASH 5 
XMLSocket capabilities. The bridge layer can be used to communicate between the active 
socket component, i.e., the receiver layer, and the Flas h FLASH movie, such as via a 
"LiveConnect" interface. The client device receives a command from the server via the 
receiver layer and passes it through the bridge layer to the FlashFLASH movie. Any client- 
side processing or logical operations are performed, and the push command, the data, or the 
software command is sent to the client device directing the presentation of the Flas hFLASH 
movie. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram of a first system according to the present invention for 
synchronizing a Flash FLASH movie on a client device with a programming signal, and for 
server-side control of the Flash FLASH movie; 

FIG. 2 is a block diagram illustrating an exemplary client device according to the 
present invention; 

FIG. 3 is a flow diagram illustrating a method according to the present invention for 
synchronizing a Flash FLASH movie on a client device with a programming signal, and for 
server-side control of the Ftas kFLASH movie; 

FIG. 4 is a diagram of a second system according to the present invention for server- 
side control of a Flash FLASH movie, the second system including a producer sending 
commands to a Flash FLASH movie on a client device, the commands relating to a Temporal 
Signal; 

FIG. 5 is a flow diagram illustrating a method according to the present invention for 
server-side control of a Flash FLASH movie; 

FIG. 5a is a flow diagram illustrating a method according to the present invention for 
loading a Flash F LASH movie on a client device; 

FIG. 5b is a flow diagram illustrating a method according to the present invention for 
transmitting a command from a producer to a server; 

FIG. 6 is a diagram of a third system according to the present invention for server-side 
control of a Flash FLASH movie relating to a programming signal; 

FIG. 7 is a diagram of a fourth system according to the present invention including a 
first client device with a communication link to a second client device; 

FIG. 8 is a diagram of a fifth system according to the present invention for 
broadcasting a real-time data command correlating to a real-time data feed to at least one client 
device having a FlashFLASH movie; 

10 

va-121396 



FIG. 9 is a diagram of a sixth exemplary system according to the present invention for 
server-side control of a Flas kFLASH movie playing on a client device, wherein the client 
pushes commands to the server, which are then broadcast to a plurality of client devices; and 

FIG. 10 is a diagram of a seventh exemplary system according to the present invention 
for server-side control of a F4as hFL ASH movie playing on a client device, wherein the client 
pushes commands to the server, which are then sent to one other client device. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
A first exemplary system consistent with the present invention preferably combines the 
rich visual capabilities of video with the dynamic capabilities of Macromedia Flas hFLASH ™ 
10 technology to provide a synchronized experience, and to provide a means for server-side 

control of the Flas h FLASH movie. The first system preferably refers to video programming; 
however, the systems and methods described herein are equally applicable to any 
programming signal including, for example, audio, streaming video, streaming audio, 
holographic images, virtual reality signals, and any other type of Temporal Signals. 
15 Referring to FIG. 1, an embodiment of the first system 100 of the present invention for 

synchronizing a HashFLASH movie 122 on a client device with a programming signal 104 via - 
server-side control of the Flash FLASH movie 122 is illustrated. This embodiment allows a 
client device 1 12 to receive a programming signal 104, such as a video programming signal, 
with an embedded Uniform Resource Identifier URI, collectively the combined signal 108. 
20 An URI, for example, may identify to the client device 1 12 an address location on a network 
120 where a Flas hFLASH movie 122 is located. The client device 112, whether automatically 
(for example, a push) or upon client direction (for example, a pull), retrieves Flas hFLASH 
movies 122 from the address location. The client device 112 may be a personal computer, a 
set-top box, a digital TV, a Web tablet, a PDA, a wireless device, or any other device with a 



25 



connection to a network and the ability to run a Web browser with a Flas hFLASH player. A 
Flash FLASH player on a personal computer or other client device, for example, may be used 
as a screen saver for 
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taking over a display screen if there are no user inputs such as keystrokes or mouse 
movements for a specified duration. Thus, the Ftas hFLASH movie may provide animations, 
graphics, text, and the like on the display. Alternatively, the client device 112 may be any 
device capable of running a stand-alone FlashFLASH player and communicating with a 
5 network 120. 

In the embodiment illustrated in FIG. 1, the client device 1 12 is also preferably 
connected to either a cable and/or broadcast television connection or to a local VCR or other 
video source, and receives a programming signal by that connection. The programming signal 
104 can then be processed for presentation, such as for display on a screen of the client device 

10 112 using any conventional PC card capable of displaying NTSC signals on a screen, such as a 
WinTV card, and/or played over a speaker of the client device 112 using any conventional PC 
audio card. Alternatively, the client device 112 may be run in parallel with a second client 
device for viewing video programming, such as a television or for listening to audio 
programming, such as a radio. 

15 The programming signal is preferably distributed to viewers in their homes from a 

centralized location, e.g., the programming signal source 102, and is created according to any 
conventional means known in the art. After the programming signal is created, an URI or a 
plurality of URI(s) are embedded into the programming signal 104 via the URI encoder 106. 
In one embodiment, for example, the URI can be embedded into the Vertical Blank Interval 

20 ("VBI") of the video programming by the URI encoder 106. In this embodiment, the URI is 
preferably encoded into eight fields of line 21 of the VBL Line 21 is the line associated with 
close captioning, among other things. However, the URI could also be embedded in other 
fields of the VBI, in the horizontal portion of the video, as part of the audio channel, in any 
subcarrier to the video, or if digital, in one or more of the data fields. In a video programming 

25 embodiment, the particular information in line 21 is not part of the visual part of the program, 
is not perceptible to the human eye, and, thus, is ideal to send data information to the users. 
While the bandwidth capacity of line 21 is limited, because the 
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system transmits only the URI(s), and not full Flash FLASH movies, there is more than enough 
capacity. Furthermore, no additional hardware is necessary at the client device to implement 
the elements of the present invention. Thus, the present invention has the additional 
advantages of being very efficient and takes advantage of conventional hardware. 
5 Although FIG. 1 shows the programming signal with an embedded URI transmitted 

over the same line, the URI(s) alternatively can be transmitted independently of the 
programming signal on the same data channel or over a different data channel, or via the 
network itself. In this embodiment, the URI(s) can be forwarded to the remote sites either 
prior to initiation or during the transmission of the programming signal 104. In one 
10 embodiment, the URI(s) have associated time stamps, which indicate to the subscriber 

platforms (e.g., the client device 112) when, during the programming signal 104, to fetch and 
play Flas hFLASH movie(s), which can be obtained via the network 120 or other device 
identified by an address specified by the particular URI(s). As shown in FIG. 1, a 
Flas hFLASH movie 122 is illustrated as being associated with the address provided in the 
1 5 URI. The Flas hFLASH movie 1 22 may reside on a server or any other device that may be 

identified by an address or similar designator and from which the Flas hF LASH movie may be 
obtained. For example, when the Flas hF LASH movie 122 associated with a given URI is 
provided on a CD or DVD, the URI may refer to a location on such computer readable 
medium at which the data of interest (i.e., the FlashFLASH movie) is stored. In such an 
20 embodiment, the DVD player effectively operates as a server by providing the Flas hFLASH 
movie 122 to the client device 1 12. In the preferred embodiment for this system 100, however 
the URI suitably identifies a server accessible via the network 120, for example, the Internet. 
Alternatively, as discussed in more detail below, the user can select when to call the particular 
Flas hFLASH movie(s) for display with the programming signal 104. 
25 Once the programming signal 104 is created, it can be transmitted to user sites over any 

transmission means, including broadcast, cable, satellite, or Internet, and may reside on 
servers, such as video or audio servers. Furthermore, the programming signal 104, one or 
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more URI(s), and/or the combined signal 108 can be encoded on a storage medium, such as a 
VHS tape, a Beta tape, an audio tape, a digital audio tape ("DAT"), DVD, CD, CD-ROM, CD- 
R, CD-RW, or other storage medium. Also, digital recording mechanisms and devices, such 
as a TiVO® unit, may be utilized to record and/or play back any recordings of the 
5 programming signal 104, the URI(s), and/or the combined signal 108. 

The programming signals 104 and/or the combined signal 108 may also be 
communicated as a live or prerecorded signal to the client device 112. Such communications 
may be pre-set (for example, based upon a network broadcast schedule), may be real-time (for 
example, when a breaking news event occurs), and/or may be on-demand. For example, the 

10 programming signal 104, the URI(s), and/or the combined signal 108 may reside on audio 
and/or video servers until requested by a client (for example, as video on demand). 

In the embodiment illustrated in FIG. 1, for example, a local URI decoder 110 receives 
the combined signal 108 including the programming signal 104 with the encoded URI(s). The 
local URI decoder 1 10 extracts the URI(s), preferably embedded in the VBI, with the use of 

15 any conventional decoder device. The URI decoder 1 10 may include a stand-alone unit, 

include hardware associated with the client device 112, such as a card that is connected to the 
client device, and/or a software application running on the client device 112. Alternatively, 
the URI decoder may be located at a server connected with the network. When the URI 
decoder receives the combined signal 108, it strips out the URI(s), such as from line 21 of the 

20 VBI, and delivers the URI(S) independently to a server. The URI is then subsequently 
delivered via the network 120 to the client device 112. Simultaneously, the programming 
signal 104 is broadcast over conventional broadcast or cable transmission means to the client 
device 1 12. 

When the client device 1 12 receives the URI, the Ras kFLASH movie 122 residing at 
25 the URI is loaded into the memory of the client device 112. Preferably, the client device 112 
automatically establishes a communications link with a server located at the URI, accesses 
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the URI, and loads the Flas h FLASH movie 122 (i.e., a configuration often referred to as a 
"push"). Alternatively, the client device 112 may be configured to establish the 
communications link with the server upon the receipt of an URI and a command from a client 
directing the client device 1 12 to retrieve the FlashFLASH movie 122 (i.e., a configuration 
often referred to as a "pull"). As such, the client device 112 may be configured to be "pushed" 
or to "pull" Flash FLASH movies identified by an URI provided in conjunction with a 
programming signal 104. 

The URI decoder 1 10 of FIG. 1 preferably routes the URI(s) to a device or a portion of 
the client device 112 configured to receive URI(s), such as a Web browser on a personal 
computer, a set-top box, a digital TV, a wireless device, a gaming console, a wireless 
telephone, a PDA, or any other device capable of presenting a Flash FLASH movie. Since the 
URI(s) identify FlashFLASH movies 122, which require Flas hFLASH capabilities, preferably 
the Web browser 136 (shown in FIG. 2) includes a Flas hFLASH™ player. However, the 
client device 112 may also be configured with a stand-alone Flas hFLASH™ player (i.e., a 
Flas hFLASH™ player that operates independent of or in conjunction with a Web browser in 
order to present a Flas hFLASH movie). Currently, any Flas hFLASH ™ equipped Web 
browser (for example, a Microsoft® Internet Explorer® or Netscape® Navigator™ browser) is 
capable of presenting a Flash FLASH movie without modification to the Flash FL ASH movie 
or to the Web browser. As shown in FIG. 2, for the first embodiment of the present invention, 
a Flas hFLASH ™ compatible Web browser 136 is used to present the Flas hFLASH movie 122. 

However, it is anticipated that as Flas hFLASH Movies become more ubiquitous, 

devices will be provided for presenting Flash FLASH Movies without requiring or utilizing the 

full capabilities of a Web browser. As such, the client device 112 preferably may be 

configured to provide a platform for receiving URI(s) and presenting Flash FLASH movies 122 

in conjunction with or separate from the reception and presentation of a programming signal 

104. Such a client device 112 may not require or utilize the full capabilities of a Web browser 

operating on a personal computer or similar device. Thus, it is to be appreciated that for the 
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system 100 shown in FIG. 1, the client device 112 provides the capabilities of identifying, 
locating, retrieving and presenting Flash FLASH movies in conjunction with a programming 
signal by utilizing URI(s) or other schemes for identifying local and/or remotely located 
Flas hFLASH movies. 

5 For the embodiment shown in FIG. 1, the client device 1 12 suitably communicates 

with a server 126 and provides any URI(s) received from the URI decoder 1 10 to the network 
120 over a suitable communications link 1 18. In FIG. 1, a single bi-directional 
communications link is commonly adequate for facilitating communications between the client 
device 112 and the network 120. However, in certain embodiments, wherein high speed 

10 communications are utilized, parallel and/or numerous communications links may be utilized. 
Further, the communications links shown in FIG. 1, and throughout the Figures, are provided 
for illustrative purposes only and are not to be construed as depicting an actual or preferred 
hardwire configuration. As is commonly appreciated, Web browsers commonly connect with 
a server, associated with a particular URI, via the Internet, a Local Area Network ("LAN"), a 

15 wired network, a wireless network, a combination wired and wireless network and/or a 
proprietary system providing a non-standard extension such as a Distributed Community 
Network ("DCN"). For a description of a DCN, see United States Patent application serial 
number 09/396693, which was filed on September 15, 1999 in the name of inventors Craig 
Ullman et al., and is entitled "Enhanced Video Programming System and Method for 

20 Providing a Distributed Community Network", the contents of which are herein incorporated 
by reference in their entirety. 

In the embodiment illustrated in FIG. 1, a producer 1 14 is connected with a server 116, 
which is connected to the client device 112. In this embodiment, the server 1 16 is shown 
separate from the network 120. The server 116, however, may also be a server residing on the 

25 network 120. Connected with the client device 112, via the server 116, the producer 1 14 may 
direct the Flash FLASH movie 122 to relate with the programming signal 104, and 
additionally, or alternatively, direct the Flash FLASH movie 122 to relate to other Temporal 
Signals. 
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For example, the producer, using a command line interface, may issue a command to the 
Flas hFLASH movie 122 residing on the client device 112. The command will be sent to the 
server 116, which in turn will send the command to the client device 112. 

An exemplary client device is illustrated in FIG. 2. The client device 1 12 includes a 
Flas hFLASH master movie 130, a receiver 132, and a bridge layer 134, running in a browser 
window 136 with scripting capabilities such as JavaScript or VBScript. The receiver 132 is 
connected to a server. Preferably, the receiver 132 is implemented as an ActiveX control or a 
Java Applet, and facilitates communication between the Flas hFLASH movie, e.g., the 
Ftos bFLASH movie 122 shown in FIG. 1, and the server. The server may be a Web server, a 
DCN server, or any other type of server. The receiver communicates with the bridge layer 
134, which in turn communicates with the Flas hFLASH movie 130. The bridge layer 143 
may, for example, run in the browser window with scripting capabilities such as, but not 
limited to, JavaScript or VBScript (hereinafter, for simplicity, the terms "bridge layer" and 
"JavaScript layer" are used interchangeably although one skilled in the art would readily 
appreciate that the bridge layer may be implemented using JavaScript, VB Script, or other 
known scripting capabilities). 

A first method consistent with the present invention relates a Flas hFLASH presentation 
with a programming signal. Referring to FIG. 3, a preferred method for relating a 
Flash FLASH presentation with a programming signal, such as a video programming signal, is 
illustrated. In operation 300, a user of the client device preferably launches a Web browser 
having a Flash FLASH player. The client device, for example, may be a personal computer, a 
set-top box, a wireless device, or any other device with a connection to a network and the 
ability to run a Web browser. Alternatively, the Web browser may include a Flash FLASH 
plug-in, which facilitates the execution of a Flash FLASH movie on the client device. 
Alternatively, the client device may be capable of running a stand-alone Flas hFLASH Player, 
such as a Sony PS2 Game Console™, and communicating with the network. A preferred 
embodiment of the client device is illustrated in FIG. 2. 
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In operation 310, the client device receives a programming signal having an embedded 
URI, which preferably directs the Web browser to a network location, such as a Web site, with 
a Flash FLASH movie relating to the programming signal. Preferably, as discussed 
hereinbefore, the URI may be embedded in the first 21 lines of the VBL Alternatively, the 
URI may be sent independently of the programming signal, such as via a server. The delivery 
of the URI for the movie that relates to the programming signal is a means for synchronizing a 
Temporal Signal, such as a programming signal, with a Flash FLASH movie. 

In operation 320, the client device is connected with the Web page corresponding to 
the URI, the Web page having the master movie. In operation 330, the FlashFLASH movie is 
loaded on the client device. In one embodiment, the URI is accessed and the Flash FLASH 
movie is downloaded automatically by the client device when the URI is received. 
Alternatively, the user may manually enter the URI into the browser, and connect with the 
Web page, and download the master movie. Preferably, the downloaded Flas hFLASH movie 
is a master movie. 

As used herein, the master movie is preferably a Flas hFLASH movie having the core 
functionality relating to the programming signal. For example, a master movie designated to 
relate with a live television broadcast of a football game, may include touchdown graphics, 
and text corresponding to key players on the teams. Non-core functionality, which may be 
pushed to the master movie by the producer according to the present invention, might include 
a sudden death overtime graphic. In an alternative example, such as with the system 400 of 
FIG. 4, the Flas hFLASH movie 412 is generally a stand-alone presentation, which may be 
controlled by a producer 404 or controlled by a server-side playlist, script, application, or other 
functionality on the server according to the present invention. As is well known in the art, 
Macromedia ActionScript™ is an object-oriented scripting language that allows a user to 
define a set of instructions that run when a triggering event occurs. There are various events 
that trigger a script including the viewer clicking on a button or the movie reaching a certain 
point along its timeline. For example, a button may be displayed on the Flas hFLASH movie 
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that is associated with a script that jumps to an URI, such as a URL, and fetches a document, 
conceptually similar to an HTML hyperlink, and when the viewer clicks on the button the 
script is executed and the document is fetched. In another example, a movie may be stopped 
when it reaches a certain point along its timeline such as when a Web site's introductory 
graphics have concluded. 

In operation 340a (FIG. 3), a programming event is started, and in operation 340b, the 
master movie is started, preferably contemporaneously with the programming event, and the 
events are synchronized, and or related to one another through server-side control of the 
FteshFLASH movie on the client device according to one embodiment of the present 
10 invention. 

According to the present invention, the Flash FLASH movie running on the client 
device may be synchronized with the programming signal through server-side control. In 
addition, according to the present invention the Flas hFLASH movie on the client device may 
be directed by the producer, or directed by server-side controls. The client device, such as the 
15 client device illustrated in FIG. 2, is connected with the server. 

One example consistent with the present invention for server-side control of the 
HashFLASH movie on the client device includes having a playlist resident on the server, the 
playlist being for the Flash FLASH movie being presented on the client device. The playlist 
includes a timeline, and at least one command related to the timeline. The playlist may be 
20 played from the server, which will issue the command at the appropriate time to the 

Flas hF LASH movie playing on the client device. To synchronize the Flash FLASH movie on 
the client device with the programming signal, the playlist timeline and associated commands 
are related to the programming signal. For example, consider a live video broadcast of a 
football game. The playlist can include prescripted commands that direct a pre-show 
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Flas hFLASH movie, which may be downloaded with the master movie or fetched by the 

master movie, to execute along with the preshow portion of the programming signal. The 

playlist, for example, may include a set of time/push pairs, such as the example shown in 

Table 1. In this example, the playlist includes two URI pushes 
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and a functional push. Thus, at times 1 :00 and 2:05, URI pushes are provided to the 
application, and the application may retrieve Enhanced Content from the locations indicated 
by the URI(s) at the respective times. Then, at time 3:10, a functional push directs the 
application to execute a ShowData function with the parameters 32/23/13. In a live video 
5 broadcast of a football game, for example, the first and second URI pushes may direct the 
application to retrieve and play prerecorded pregame shows for each of the teams involved. 
The functional push may then direct the application to display the parameters 32/23/13, which 
may be live or prerecorded data related to the football game, e.g., scores, player statistics, and 
team statistics, or unrelated to the football game, e.g., stock tickers, advertisements, and 
10 breaking news updates. One benefit of having the playlist on the server is that commands can 
be issued or broadcast to a plurality of client devices at the same time, and can be sent in 
temporal relationship with the programming signal. In this way, the Fias hFLASH medium 
becomes a synchronized mass media mechanism akin to traditional mass media such as 
television or radio. 



15 Table 1 

Time Push 

1 :00 http://www.hypertv.com/pushl .swf 

2:05 /push2.swf 

3:10 {command: ShowData (33/23/13)} 

20 A second example consistent with the present invention for server-side control of the 



FiashFLASH movie on the client device includes the producer issuing a command, or 
commands, to the Fiash FLASH movie playing on the client device. This functionality allows 
the producer to direct the Fiash FLASH movie as it relates to the programming signal or to 
other Temporal Signals. In one embodiment, such as shown in FIG. 1, using a command line 
25 interface ("CLI"), the producer 114 can send a command to the server 116, which in turn will 
issue the command to the client device 112. The Fiash FLASH movie on the client device, 
preferably via a persistent socket 
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connection maintained by the receiver 132 (shown in FIG. 2) and the programming resources 
maintained by the JavaScript layer 134, will execute the command. For example, if the 
football game goes into sudden death overtime, the producer can send a command to the 
Flash FLASH movie 130 on the client device 1 12 to play a sudden death graphic, which was 
not part of the playlist on the server for the football game master movie, perhaps because it is 
unexpected or uncertain. In another example, the producer 114 (shown in FIG. 1) can create a 
new Flash FLASH movie and save it at a location identified by an URI, and send a command to 
the Flash FLASH movie 130 on the client device to connect to the URI, load the new 
Flas h FLASH movie and present it. 

Flas h FLASH also includes functionality referred to as ActionScript "methods," which 
can be called from the browser, to control a movie in the Flash FLASH Player from Web 
browser scripting languages such as JavaScript and VBScript. Such a method is generally a 
predefined Flas hFLASH function that can be called from a host environment, which is any 
device capable of running a FlashFLASH movie (such as a Web browser or a stand-alone 
FlashFLASH player), to the FlashFLASH movie. An exemplary method is "GotoFrame," 
which starts playing the Flash FLASH movie at the specified frame. A second exemplary 
method is "LoadMovie," which loads an external movie from a specified URI. In one 
example, the producer can send new software methods to the Flash FLASH movie on the client 
device by commanding the download of a new Flash FL ASH movie. The new Flash FLASH 
movie, for example, may include new software functionality with or without any additional 
visual or audio components. Alternatively, the playlist could be sent and loaded on the client 
device from the server. With the playlist resident on the client-side, the system could prefetch 
Flash FLASH content to use for later playback with or without a network connection. 

A third example consistent with the present invention for server-side control of the 
Flas hFLASH movie on the client device 112 includes pushing a command to jump to a movie 
clip index, i.e., functionality is pushed to the client device 1 12. The object, or other 
functionality, at the frame location or index, executes when the location is pushed. For 
example, the 
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producer 114 may want certain text located at a specified URI to be displayed on a layer of the 
Flash FLASH movie. The producer will push a command to jump to the index through the 
JavaScript layer 134 (shown in FIG. 2), which will direct the Flas hFLASH movie to the index 
having a getURL command, which will access the URL, get the appropriate text, and display it 
in a window, such as the text layer. In this example, the getURL command was prescripted 
and the producer 114 commanded the movie to jump to the index location for the command, 
wherein the functionality for accessing the URL was located. 

In a fourth example consistent with the present invention for server-side control of the 
Flash FLASH movie on the client device, the producer 114 may push new functionality, such as 
a new JavaScript function expressed as a string, to the JavaScript layer 134 on the client device 
1 12. This is especially useful for unforeseeable or uncertain events, and for non-core 
functionality. For example, there may be a breaking news event, and the producer 114 
generates a Flas hFLASH movie including text discussing the event and places it at a specified 
URI. The movie may include additional functionality, such as to change text as events change. 
The JavaScript would be able to access the new functionality in the new movie, and 
accordingly set the appropriate variables in the movie. The producer 114 may send the 
Movieclip.LoadMovie method to the client device 112, whereby the JavaScript layer 134 will 
communicate with the Flas hFLASH movie using, for example, MovieClip.SetVariable or 
MovieClip.LoadMovie methods. The newly-loaded Flas hFLASH movie could incorporate and 
execute the new functions as a new ActionScript function. 

FIGS. 1, 4, 6, and 7 each illustrate a single client device, however, the present invention 
is equally applicable to any number of client devices. Accordingly, in one example of the 
present invention a single playlist running on a server, or a plurality of servers, can broadcast 
playlist commands to any number of client devices connected with the server, and thereby 
synchronously direct the Flas hFLASH movies playing on the respective client devices. 
Moreover, the producer can issue commands to any number of subscribers, and the 
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subscribers preferably all playing the same Flas hFLASH movie on their respective client 
devices will contemporaneously receive the commands issued by the producer, and the 
Flas hFLASH movie playing on their client machine will contemporaneously react to the 
commands. Alternatively, the subscribers may be playing different FlashFLASH movies, and 
are all pushed commands relating to a Temporal Signal, such as a breaking news event, which 
will be displayed on the same portion of their respective client devices. Flash FLASH playback 
systems synchronized in such a manner could become a mass medium akin to traditional mass 
media such as television and radio. 

A second exemplary system 400 consistent with the present invention provides for 
server-side control of a Flas hFLASH movie 412 running on a client device. Referring to FIG. 
4, an embodiment of the second system 400 of the present invention is illustrated. In this 
embodiment, a client device 416 is connected to a network 410, such as a wireless network, an 
intranet, an extranet, or the Internet. Preferably, the Flash FLASH movie 412 resides at a site 
on the network accessible via an URI entered into a browser running on the client device 416, 
and the Flas h FLASH movie 412 is loaded on the client device 416. Alternatively, the 
Fla s h FLASH movie 412 may be loaded from a CD-Rom, a floppy disk, or from any memory 
element connected to the client device. Preferably, the Flas hFLASH movie 412 loaded on the 
client device 416 is a master movie having core functionality as discussed herein. The present 
invention, however, works equally well with Flas hFLASH movies 412 having any degree of 
functionality. 

A producer 404 is also connected with the network. To cause the Flash FLASH movie 
412 to be reactive to Temporal Signals 402, the producer may push playlist commands to the 
Flas hF LASH movie 412, and may push new functionality, such as a new Flas hFLASH movie, 
to the client device 416. Preferably, the Flas hFLASH movie 412 includes an ActionScript 
script. Accordingly, the producer 404 may push methods to a JavaScript layer 134 (shown in 
FIG. 2) running on the browser 136, which will expand the functionality of the JavaScript layer 
134. For example, a client may be playing a Flas hFLASH movie corresponding to a music 
video, when an unrelated 
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Temporal Signal, such as a team winning a sporting event occurs. The producer 404 can create 
a Flas hFLASH movie 406 relaying the Temporal Signal, such as a Flas hFLASH movie 
including a layer with a graphic displaying the winning team and a layer with the score of the 
game. The producer 404 can push a command, using a server, to the Flash FLASH movie 412 
on the client device 416, instructing the Flas hFLASH movie 412 to fetch and play the new 
Flash FLASH movie 406 for the winning team on the client device 416. The enhanced 
JavaScript layer would allow for completely new presentation logic to be added to the 
FfeshFLASH movie dynamically. In the beginning of the presentation, there might not be a 
presentation resource to show team scores. After the enhancement through the pushing of 
additional code (e.g., both JavaScript and Flash FLASH) , however, the Flash FLASH movie 
would have this new capability. 

A method consistent with the present invention provides for server-side control of a 
Flas hFLASH movie playing on a client device. Additionally, a method consistent with the 
present invention provides for server-side control of a Flash FLASH movie playing on a client 
device responsive to a Temporal Signal, or responsive to commands from a producer. 
Referring to FIG. 5, a method for server-side control of a Flas hFLASH movie is illustrated. 

In operation 500, a Flas hF LASH movie is loaded on a client device. Preferably, the 
client device is any device with a network connection or a connection to a provider of a 
Fla s h FLASH movie, and the ability to play a Flas hF LASH movie, such as a personal 
computer, a set- top box, a wireless device, a Web tablet, a PDA, and the like. Preferably, the 
client device includes a Web browser with a Flash FLASH player. 

Referring to FIG. 5a, the preferred operations for loading a Flas hFLASH movie on a 
client device are illustrated. In operation 502, the user launches a Web browser having a 
Flas hFLASH plug-in, such as Microsoft Internet Explorer™, on the client device. In operation 
504, the Web browser is connected with a network location, such as a Web site, having a 
Flas hFLASH movie. This is preferably done by the user. Alternatively, consistent with FIG. 
1, an URI for the Web site having the Flash FLASH movie may be delivered along with a 
Temporal Signal. 
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subscribers preferably all playing the same Flash FLASH movie on their respective client 
devices will contemporaneously receive the commands issued by the producer, and the 
Flas hFLASH movie playing on their client machine will contemporaneously react to the 
commands. Alternatively, the subscribers may be playing different Flas hFLASH movies, and 
are all pushed commands relating to a Temporal Signal, such as a breaking news event, which 
will be displayed on the same portion of their respective client devices. FlashFLASH playback 
systems synchronized in such a manner could become a mass medium akin to traditional mass 
media such as television and radio. 

A second exemplary system 400 consistent with the present invention provides for 
server-side control of a Flas h FLASH movie 412 running on a client device. Referring to FIG. 
4, an embodiment of the second system 400 of the present invention is illustrated. In this 
embodiment, a client device 416 is connected to a network 410, such as a wireless network, an 
intranet, an extranet, or the Internet. Preferably, the FlashFLASH movie 412 resides at a site 
on the network accessible via an URI entered into a browser running on the client device 416, 
and the Flash FLASH movie 412 is loaded on the client device 416. Alternatively, the 
Flas hFLASH movie 412 may be loaded from a CD-Rom, a floppy disk, or from any memory 
element connected to the client device. Preferably, the FlashFLASH movie 412 loaded on the 
client device 416 is a master movie having core functionality as discussed herein. The present 
invention, however, works equally well with Flash FLASH movies 412 having any degree of 
functionality. 

A producer 404 is also connected with the network. To cause the Flash FLASH movie 
412 to be reactive to Temporal Signals 402, the producer may push playlist commands to the 
Flash FLASH movie 412, and may push new functionality, such as a new F : lashFLASH movie, 
to the client device 416. Preferably, the Flas hFLASH movie 412 includes an ActionScript 
script. Accordingly, the producer 404 may push methods to a JavaScript layer 134 (shown in 
FIG. 2) running on the browser 136, which will expand the functionality of the JavaScript layer 
134. For example, a client may be playing a Flash FLASH movie corresponding to a music 
video, when an unrelated 
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Preferably, the URI may be in the first 21 lines of the vertical blanking interval of a video 
programming signal. Alternatively, the URI may be received directly from a Web server, or 
the user may enter the URI into the browser manually. For example, the user may be watching 
an event on TV, which indicates that an interactive Flas hFLASH presentation for the TV event 
is available at a certain Web page, and the user connects their client device to the appropriate 
URI for the Web page. 

In operation 506, the Fla s h FLASH movie is loaded on the client device. The 
Flas hFLASH movie may include core functionality, or may simply provide a vehicle for 
communication with the server, as discussed below, in which case the functionality will be 
pushed to the Flas hFLASH movie from the server responsive to commands by the producer. 
In operation 508, the Flash FLASH movie is played. 

Referring again to FIG. 5, in operation 510, a connection between the client device and 
a server is established. Preferably, the client device includes a receiver (e.g., ActiveX, a Java 
Applet, or a Web server connection) and a bridge layer (e.g., a JavaScript or VBScript layer). 
In an alternative embodiment, for version Flash F LASH 5.0 and higher, the ActionScript object 
XMLSocket can be used, which allow a continuous connection with a server to be established. 
The FlashFLASH movie may be a stand-alone application commonly called a Projector. 
However, the user may desire to have the FlashFLASH movie reactive to Temporal Signals, 
such as breaking news stories, or stock prices. Alternatively, the Flash FLASH movie may 
provide core functionality, and the producer may push new functionality to the user based on 
the characteristics of the user, such as user profile information. For example, the producer may 
learn that the user is a 30 year old male, living in Boulder, Colo. Based on this demographic, 
the producer may push a Flas hF LASH movie advertising high-end mountain bikes to the user. 

Referring again to FIG. 5, in operation 520, the producer sends a command, directing 
some functionality of the Flash FLASH movie, to the server. Referring to FIG. 5b, a preferred 
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method of producer control of the Flas hFLASH movie is illustrated. In operation 522, the 
producer identifies a Temporal Signal, such as a breaking news story, or identifies a 
characteristic of the user. In operation 524, the producer sends a control signal to the server 
responsive to the Temporal Signal, or the characteristic of the user. For example, the producer 
could send a command to the server, perhaps using a CLI, that directs the master movie to 
display a Web page with a breaking news story. 

In operation 530, the server transmits the control signal to the FteshFLASH movie 
using the connection between the client device and the server. Preferably, the control signal is 
sent using the continuous connection between the client device and the server established with 
the receiver and JavaScript embodiment. The control signal causes some functionality in the 
playlist of the Flash FLASH movie to be executed. In one embodiment, the control signal is a 
command to jump to an index in the timeline of the JFlashFLASH movie, and causes the 
functionality at the index to execute. For example, the index may include a getURL command 
that fetches a document located at the URL, and displays the document in a browser window. 
In another embodiment, the control signal corresponds to new functionality, which is inserted 
in the Flash FLASH movie as a new movie with additional functionality, or in a layer between 
the Flash FLASH movie and the JavaScript Layer within the browser. 

A third exemplary system 600 consistent with the present invention combines 
programming with the dynamic capabilities of Flas hFLASH movies to provide a synchronized 
experience. The third system 600 also provides for server-side control of the Flash FLASH 
movie 622 whereby a producer 618, or server-side playlist, application, object, or script is 
capable of controlling the FlashFLASH movie. Referring to FIG. 6, an embodiment of the 
present invention is illustrated that allows a client device 610 to receive a programming signal 
604 with an embedded URI that directs the client device to address locations on the network to 
retrieve a Flas hFLASH movie 622 located at the address, collectively, the combined signal 
608. Alternatively, the Flas hFLASH movie 612 may be downloaded directly to the client 
device from a CD-ROM, a 
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floppy, or from a memory device connected with the client device. As discussed above, the 
FlashFLASH movie may include an ActionScript script. In this embodiment, a producer 618 is 
connected with the client device via a network 616, such as the Internet, an extranet, or 
wireless network, and the producer 618 directs the Flash FLASH movie 612 to synchronize the 
Flas hFLASH movie with a programming event, and/or to relate or synchronize to other 
Temporal Signals. 

A fourth exemplary system 700 for providing server-side control of a Fla s h FLASH 
movie on a client device, consistent with the present invention, is illustrated in FIG. 7. In this 
embodiment, a first client device 710 receives a programming signal 704 from the 
10 programming signal source 702. The URI encoder 706 preferq^ly embeds an URI for a 

Flas hFLASH movie relating to the programming signal, collectively, the combined signal 708. 
Similarly to the first system discussed with reference to FIG. 1, an URI encoder 706 encodes 
the URI into the programming signal 704. The first client device 710, e.g., a digital TV, set- 
top box, or a personal computer, extracts the URI from the combined signal 708. The second 
15 client device 712, e.g., a PDA such as a Palm™ device, a Web tablet, or a lap-top computer, 
has a communication link with the first client device. The communication link may be hard 
wired connection such as a serial, Universal Serial Bus ("USB"), parallel, or other hard wired 
connection, or may be through a network such as a Bluetooth™ wireless network, the Internet, 
an extranet, or an intranet. After the first client device 710 extracts the URI, it is sent to the 
20 second client device 712 over the communication link. Preferably, the second client device 
712 is connected to a network 714, which may also provide the communication link with the 
first client device 710. When the second client device 712 receives the URI, the Flas hFLASH 
movie 718 residing at the URI is loaded on the second client device 712. The second client 
device 712, via the network 714, is connected with the producer 716 and/or a server. 



25 



Accordingly, through the various methods discussed herein, the Flas hFLASH movie 718 
residing on the second client device 712 can be controlled from the producer 716 and/or a 
server. For 
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example, a playlist on a server can broadcast playlist commands to all client devices 
subscribing to the enhanced content. 

A fifth exemplary system 800 for providing server-side control of a Flas hFLASH 
movie on a client device 806, consistent with the present invention, is illustrated in FIG. 8. In 
this embodiment, a Flash FLASH movie is playing on a client device 806, and a data feed 802 
streams into a server 804 that parses the data feed 802 and generates commands derived from 
the data feed 802, which are broadcast to all subscribers to the broadcast, and the data is 
incorporated into the FlashFLASH movie playing on the client device 806. The data feed 802 
is sent to a server 804, such as a Web server or DCN server. The server 804 encapsulates the 
data with the appropriate command to incorporate the data into a FlashFLASH movie playing 
on the client device 806. The command and associated data is then broadcast to all subscribers 
to the data feed 802. The client device 806 preferably includes the functionality as discussed 
with reference to the exemplary client device illustrated in FIG. 2. Accordingly, the receiver 
132 receives the command and associated data. If the Flas hFLASH movie is contained within 
a browser, for example, the command and associated data is relayed to the JavaScript layer 
134, which communicates the command and associated data to the Flas h FLASH movie 130, 
and the data is presented. Alternatively, the command and associated data may be relayed 
directly to the presentation layer if the Flas hF LASH movie contains the receiver and 
presentation functionality, such as a Flas hFLASH 5 movie utilizing XMLSocket functionality. 

In one embodiment, for example, a user may subscribe to a stock-ticker data feed. 
Unlike HTML, the present invention allows the stock-ticker to continuously update, without a 
refresh. The stock-ticker data feed streams into the server, and the server incorporates the data 
with a command. For example, the command may instruct the Flas h FLASH movie to display 
stock prices in the upper left hand corner of the browser window. 

A system 800 may control the presentation of a data on the client device in a 
FlashFLASH 5 movie using XMLSocket as the receiver layer. The data, for example, may be 
a clock that is 
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updated every second under the control of a server. One exemplary Java application that may 
be compiled and installed as a server for controlling the display of a FlashFLASH clock movie 
on a single client device is listed below. In this example, the clock is supplied by a Java 
Function call. 



5 import j ava . awt . event . * ; 
import java.util.*; 
import java.awt.*; 
import j ava . io . * ; 
import java.net.*; 

10 

/** 

* 

* ClockServer 

* Example Server for System and Method for Server-Side Control of a Flash 
15 * Presentation 

* Will handle one example Flash client at a time. 

* Usage: java -cp ./ ClockServer port 
* 

20 * ©author Jeff Harrington 
*/ 

public class ClockServer implements Runnable{ 
ServerSocket ClockServer; 
25 Socket clientSocket; 

Thread clockThread; 
PrintWriter out; 

public ClockServer (int port) { 
30 s tartClockServer (port ) ; 

) 

private void s tartClockServer (int port) { 

System, out. print In ("Starting the clock server"); 
if (clockThread == null) { 

clockThread = new Thread(this, "Clock"); 
clockThread. start ( ) ; 

) 

try { 

ClockServer = new ServerSocket (port) ; 

System, out .println( "ClockServer running port: " + port); 
while (true) { 

clientSocket = ClockServer .accept () ; 
out = new 

PrintWriter (clientSocket .getOutputStream( ) , true) ; 
> 

) catch (IOException ex) { 

ex . printStackTrace ( ) ; 
System. exit (0) ; 
} catch (Exception ex) { 

ex . printStackTrace ( ) ; 
System. exit (0) ; 
) 

) 

public void run() { 
while (true) { 
try { 
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sendTime( ) ; 

clockThread. sleep (1000) ; 
} catch( java. lang. InterruptedException ex) { 
ex . printStackTrace ( ) ; 
System, exit (0) ; 

} 



} 



10 public synchronized void sendTimeO { 

Calendar calendar = Calendar . getlnstance () ; 

String time = "<TIME VALUE=\""; 

time += calendar .get (Calendar. H0UR_OF_DAY) 
t + ":■ + calendar .get (Calendar .MINUTE) 

15 + + calendar. get (Calendar .SECOND) ; 

time += "X" />■; 

time '\0' ; 

try { 

System, out. println( "TIME = "+time) 
if (out != null) { 

out .print (time) ; 
out .flush () ; 

> 

} catch (Exception ex) { * 

ex. printStackTrace ( ) ; 

} 

> 



public static void main(String args [ ] ) { 
30 if (args. length ==1) { 

ClockServer clockServer = new 
ClockServer ( Integer . parselnt (args [ 0 J ) ) ; 
} else { 

~- System, out .print In ("Usage: java -cp ./ ClockServer 

3D port") ; 

> 

> 

) 



Further, the following ActionScript code may be compiled into a Has hFLASH 5 movie 
of the client device for receiving the updated clock data from the server-side application using 



// Flash 5 ActionScript to be included into the example Flash clock display 
// movie. 

mySocket = new XMLSocket ( ) ; 
mySocket .onConnect = handleConnect ; 
mySocket . onXML = handl e Incoming; 
mySocket . connect ( " localhos t " , 1024 ) ; 

function handleConnect ( ) { 
trace ( "CONNECTED ! " ) ; 

> 

function handle Incoming (message) { 

var time = message. firs tChi Id; 
timeDisplay = time . attributes .value ; 
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// The Flash requires a Single Line Dynamic Text area with 
//variable name timeDisplay where the time will be displayed. 



The server-side application listed above runs continuously and will accept one 
Etes hFLASH movie client. The Ftas hFLASH movie connects to the server at startup and 
begins receiving an XML update expressing the time every second. The FtesfeFLASH movie 
displays the time in the text area, timeDisplay, under the control of the server-side application. 

FIG. 9 illustrates a sixth exemplary system 900 consistent with the present invention, 
which provides for server-side control of a Has hFLASH movie playing on a client device 902, 
wherein the client device 902 pushes commands to the server 904, which are then broadcast to 
a plurality of client devices (i.e., the client in effect becomes the producer). This system is 
useful, for example, in chat systems and multi-player games. Consider a multiplayer 
Ftas hFLASH movie game of the word game Scrabble™; according to the present invention, 
whenever a player makes a move by placing a new word on the board displayed on the screen 
of the client device 902, perhaps by selecting and dragging letters, a command is issued 
corresponding to the move and is sent to the server 904. The command corresponding to the 
move is then sent to all of the client devices, e.g., client devices 906, 908, and 910, connected 
to the server 904. The command is received and preferably sent through the JavaScript layer 
134 to the Flas hFLASH movie 130 on the client devices 906, 908, and 910. 

In a chat system consistent with the present invention, the client may push commands 
to the server, such as: Ignore (allows a member of a chat room to filter out unwanted chat 
messages from specific chat room members), Whisper (allows a member of a chat room to 
speak to one other particular chat room member without other chat room members seeing the 
chat), and ChangeChatRoom (allows a member to change chat rooms). These commands can 
change the client state, or the server state with regard to the users interface to the chat room, 
which are in addition to basic chat functionality such as sending text, and having the text 
broadcast to all members of the chat room. 
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In addition to the immediate availability of the application, a further advantage to 
multiplayer games, chat systems, and similar systems, is that by establishing a connection 
between the client device and the server, such as, but not limited to, through the receiver and 
the JavaScript layer on the client device or by using native Ftas hFLASH 5 ActionScript 
XMLSocket connections, whenever a command is generated in response to a user action, the 
command is sent to the server, and through server-side controls the command is broadcast and 
immediately displayed in the Ftas hFLASH movie on each player's client device. 

FIG. 10 illustrates a seventh exemplary system 1000 consistent with the present 
invention, which provides for server-side control of a Fias hFLASH movie playing on a client 
device, wherein the client pushes 1002 commands to the server 1004, which are then sent to 
one other client device 1006. This exemplary system is useful, for example, in two-player 
games and instant messaging systems. Consider a two player FteshFLASH movie game of tic- 
tac-toe; according to the present invention, whenever a player makes a move by putting an X 
or an O on the tic-tac-toe grid displayed on the screen of the client device 1002, perhaps by 
using a drawing tool, for example drawing an X on the screen of a Palm™ PDA client device 
using the Graffiti™ application, a command is issued corresponding to the X and is sent to the 
server 1004. The command corresponding to the move is then sent to the client device 1006 of 
the second player. The command is received and preferably sent through the JavaScript layer 
to the Flas hFLASH movie on the second player's client device 1006. 

One particular advantage of the present invention for two-player games, instant 
messaging services, and similar systems, is that by establishing a connection between the first 
client device and the server (i.e., preferably through the receiver and the JavaScript layer on 
the client device) whenever a command is generated by the first client device 1002 in response 
to some user action, the command is immediately sent to the server 1004, and through server- 
side controls the command can control the Flash F LASH movie playing on the second 
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client device 1006 of the second participant, e.g., the move is sent by the second game player 
or the message is received. 

The client device illustrated herein preferably includes an input mechanism for 
generating a command, which provides for two-way interactivity. In a client device such as a 
personal computer, the input mechanism is generally a keyboard or a mouse, which can be 
used to perhaps click on a button in the Flas hFLASH movie, which will generate a command 
that will be sent to all players in a multiplayer game, as discussed above. Alternatively, the 
input mechanism can include other user input mechanisms or signal generating mechanisms 
wherein the output from the mechanism generates a command, which can be sent to the server, 
and then through server-side controls sent to the client device(s). For example, an exemplary 
signal generating mechanism includes a sensor, which could generate a signal corresponding 
to some characteristic, such as the temperature, the temperature output signal from the sensor 
could be converted into a command, that according to the present invention would be sent 
through a server to the client device(s) receiving the sensor data, perhaps through a 
subscription. In another example, an exemplary user input mechanism includes a virtual 
reality suit, which could generate signals corresponding to the movements of a person wearing 
the suit, the movement output signals could be converted into a series of commands, that 
according to the present invention would be sent through a server to the client device(s). A 
Flas hFLASH movie playing on the client device could, for example, generate a series of 
FteshFLASH movie animations derived from the movement commands and display the 
Has hFLASH movie animations on the client device. Accordingly, a person with the second 
client device in a geographically remote area, could, according to the present invention, load a 
Fias hFLASH movie on the second client device, establish a connection with the server, and 
receive the movement commands from the server to display FteshFLASH movie animations 
derived from the movement commands from the first client device, i.e., users with client 
devices connected to the server could view the movements of the person wearing the virtual 
reality suit. This would be 
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useful in any number of practical uses, including: teaching, wherein students could remotely 
view and interact with a teacher; gaming, wherein games could be taken to a new level by 
virtually physically interacting with other players; and viewing sporting events, where the 
movements of the field could be viewed on the client device and the viewer could interact 
5 through perhaps a chat service. 

While the present invention has been described in relation to specific systems, 
hardware, devices, software, platforms, configurations, process routines, and a preferred 
embodiments, it is to be appreciated that the present invention is not limited to any specific 
embodiments, process, systems, devices, signal formats, data formats, and/or configurations. 
10 As such, the present invention may be considered to cover any and all subject matter, as 
specified in the attached claims. 
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